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Abstract 

In this work we study encoding/decoding schemes for the transmission of a discrete time analog Gaussian source 
over a Gaussian wiretap channel. The intended receiver is assumed to have a certain minimum signal to noise ratio 
(SNR) and the eavesdropper is assumed to have a strictly lower SNR compared to the intended receiver. For a 
fixed information leakage rate (I^) to the eavesdropper, we are interested in minimizing the distortion in soiu'ce 
reconstruction at the intended receiver, and we propose joint source channel coding (JSCC) schemes for this setup. 
For a fixed information leakage rate (le) to the eavesdropper, we also show that the schemes considered give a 
graceful degradation of distortion with SNR under SNR mismatch, i.e., when the actual channel SNR is observed 
to be different from the design SNR. 



I. Introduction, system Model and Problem Statement 
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Fig. L Problem model for the Secrecy system. 



Let us consider the classical case of transmitting a Gaussian source over a Gaussian channel having an input 
power constraint, and we are interested in estimating the source at the intended receiver with the minimum possible 
distortion. In this case, both the uncoded scheme [1] of scaling the source to match the input power constraint and 
the separation based scheme of quantization followed by channel coding are both optimal for a given channel SNR. 
Moreover, there are an infinite family of schemes that can be shown to be optimal for the above setup [2] . Compared 
to the separation based scheme, the uncoded scheme provides a graceful degradation of distortion with SNR, though 
both schemes are optimal for a given design SNR^. In this work, we consider the same communication setup but 
with an eavesdropper present, and we are interested in minimizing the distortion for the intended receiver for a 
given information leakage to the eavesdropper. For a fixed information leakage le to the eavesdropper, we propose 
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a scheme which achieves the minimal possible distortion for a given design SNR^ and also provides a graceful 
degradation of distortion with SNR. 

The source V ~ A^(0, a^) is an n- length discrete time real Gaussian source and the channel is a discrete time real 
Gaussian wiretap channel [3] as shown in Fig. 1. The source and channel bandwidths are assumed to be matched 
and hence the input to the channel is a n-length vector x, which is also assumed to have an average power constraint 
of P expressed as E[X'^] < P. Henceforth in this sequel, boldface is used to denote ra-dimensional vectors. The 
received signal at the eavesdropper ye can be expressed as 

ye = X + We. 

Here We is the n-length additive white Gaussian noise(AWGN) vector having zero mean and noise variance of a^. 
The intended receiver receives the n-dimensional vector y given by 

y = X + W, 

where the noise w is the n-length additive white Gaussian noise vector having zero mean and noise variance of cj^. 
The transmitter does not have an exact knowledge of but knows that < a"^, where is the noise variance 
corresponding to some design SNR. The eavesdropper channel is a degraded version of the main channel and is 
assumed to have the lowest SNR i.e. SNRe < SNR < SNRa, where we define SNRe := P/al, SNR^ := Pja^ 
and SNRa := P/cTa- The receiver is assumed to have a perfect estimate of SNRa, but the transmitter is assumed 
to be kept ignorant of this information. 

We refer to the information leaked to the eavesdropper as the information leakage rate and is expressed as 
/g := ^7(V; Ye). The information leakage rate is the difference between the average source entropy ^/'(V) and 
the equivocation rate ^/i(V|Ye) defined in [3] and [4]. It is fairly common to use equivocation rate in literature, 
but since we have a continuous source, the equivocation rate expressed as differential entropy may not be always 
positive. Therefore, we choose the metric as the mutual information between the source and the received signal 
which is always > 0. Notice that 7^ = corresponds to perfect secrecy, and this imphes that the eavesdropper 
gains no information about the source. 

The intended receiver makes an estimate v of the analog source v from the observed vector y. The distortion 
in estimating V can be expressed as D{SNRa) = E[{V — V)'^], where SNRa = P/(^a- work for a fixed 

information leakage rate 1^, we are interested in schemes which are optimal for SNR^i and also which provide a 
low source distortion for SNRa > SNR^. We are also interested in studying the graceful degradation in distortion 
with SNRa. This can be captured mathematically by requiring the exponent of D{SNRa) to be —1, or precisely 

SNRa-*oo SNRa 

The exponent of —1 is chosen, as it is the lowest possible exponent achievable for the matched bandwidth case 
[1], even in the absence of an eavesdropper. 

Before introducing our proposed schemes, we would like to mention some prior work in this area. There has 
been a considerable amount of work in studying the graceful degradation of distortion with SNRa for both the 
bandwidth matched case [1] and the bandwidth mismatched case, and several joint source channel coding schemes 
have been proposed [5]. There also exists a considerable amount of literature on physical layer security. The wire- 
tap channel was first introduced and studied by Wyner in [3], and the Gaussian wire-tap channel was studied by 
Leung and Hellman in [4]. In [6], Yamamoto studied the Shannon cipher system from a rate distortion perspective, 
where in one of the theorems it is shown that for a wiretap channel with a fixed SNR, a separation based approach 
of quantization followed by secrecy coding is optimal. However in this work, in contrast to [6] we are interested in 
JSCC scheme for the Gaussian wiretap channel under the SNR mismatch case. We are also interested in quantifying 
the graceful degradation of distortion with SNRa under the SNR mismatch case. 

II. A SEPARATION BASED SCHEME AND A SIMPLE SCALING SCHEME 

For the classical setup without the eavesdropper, both the uncoded scheme and the separation based scheme can 
be observed to be optimal for a given design SNR^. However these schemes perform differently in the presence of 
a SNR mismatch. In this section we look at the performance of both the separation based scheme and the uncoded 
scheme in the presence of an eavesdropper. 
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Fig. 2. Distortion vs SNRa for different schemes for /, = 0.01. Here P = 1, ct^ = 1 and = 0.01{SNRa = 20db). 



A. Separation based scheme 

Here we use a separation based scheme designed for a channel noise variance of cj^ and information leakage I^. 
We first design a vector quantizer of rate 

P\ P 



Rjj — C 



C 



where C{x) := ^log(l + x). We quantize v to Vg using the designed vector quantizer of rate Ry. ^^q is then 
mapped to v^ec using a secrecy code as in [4] . The encoded v^ec is transmitted over the channel. The eavesdropper 
obtains a maximum leakage rate of 1^. The proof of this claim is contained in the Appendix. The intended receiver 
achieves a distortion of cr^2~^^". Since we have quantized the source to a fixed rate, the achievable distortion is 
constant for all SNR's above the designed SNR and is given by, 

D{SNRa) 



^2n 



-2/?„ 2 



For the given I^, though we get some improvement in distortion, the exponent is and we do not have a graceful 
degradation of distortion with SNRa as shown in Fig. 2. 

B. A simple scaling scheme 

Let us first consider a scheme that is optimal for all channel SNRs for the Gaussian wiretap channel in the absence 
of the eavesdropper. This reduces to the classical problem of point to point communication over a Gaussian channel. 
An optimal scheme is scaling the analog source v by a constant k = ^Jpjal to match the transmit power constraint 
[1]. The transmitted vector is hence given by x = kv. The receiver has perfect knowledge of SNRa and performs 
a minimum mean square estimate of v from the observed y. The distortion obtained at the intended receiver is 
given by 



D{SNRa) 



cr:, 



1 + SNRa 

The distortion exponent can be seen to be —1 for this scheme and also the obtained distortion is optimal for every 
given SNRa- The information leakage rate is easily calculated to be 
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From the above equation we can observe that the choice of k = y^r results in a reasonably high information 
leakage rate. However, we can reduce the value of k to satisfy our eavesdropper information requirement of as 
follows by choosing 

1, ti^al. 
/,= -log(l + -f 



^2 ^ ^(22^^ - 1). 



The intended receiver receives y = kv + w. Hence the distortion at the intended receiver is given by 

2 2 

D{SNRa)- - 



Hence for SNRa = SNR^, D{SNRd) > al/{\ + SNR^) as K^al < P. Though the above equation shows 
that the distortion exponent is —1, we have a considerable loss in optimality at the intended receiver, as we have 
not used the full power P at the transmitter. This can be seen from Fig. 2 where for SNRa = 20db , we see that 
the uncoded scheme has a higher distortion performance compared to the separation based scheme. However we 
can see from Fig. 2 that the uncoded scheme gives a graceful degradation in distortion, unlike the separation based 
scheme. Also if we need 1^ = 0, then k must be chosen to be and hence D{SNRd) = a^, which is the worst 
attainable distortion equivalent to simply estimating the source. 

In the next section we show a scheme which is a combination of the schemes mentioned above, that for /c 7^ 
gives both the optimal distortion for the designed SNR as well as a graceful degradation in distortion for all SNR's 
above the designed SNR. In the case of 1^ = 0, or perfect secrecy, it is however not clear if we can get a graceful 
degradation in distortion. 

HI. Hybrid scheme using secrecy coding and vector quantization 
In this scheme we quantize the source v to get given as follows, 

V = + u. 

The quantized digital part is encoded using a secrecy code and the quantization error u is superimposed onto the 
secrecy code code and transmitted with some scaling. The transmitted vector x is given by 

X = Vsec + tU. 

Here v^ec consists of a digital part that uses a secrecy code. 

The digital part v^ec uses a power of aP and the analog part a power of {1 — a)P. 
The source v is quantized to Vg at a rate R{a) chosen as 

The encoder is the same encoder as in the Gaussian wire tap channel case [3] and [4]. We have ^ 2"^(") bins 

and 2"*^(^fi-'">^+''i) codewords in each bin. Hence the transmitted vector Vgec has a rate of C ^ (]^_^)p_)_^2 ^ • 
The intended receiver can decode the digital part and cancel Vgec from y. It then forms a minimum mean square 
estimate (MMSE) of u. Hence the obtained distortion can be expressed as 

22-2i?(a) 
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The eavesdropper obtains ye and we are interested in characterizing the information leakage rate I^. can be 
bounded as follows. 

/e = -I(V;Ye) = -/(Vq,KU;Ye) (1) 

n n 

-/(Vq;Ye) + -/(KU;Ye|Vq) (2) 

n n 

-/(KU;Ye|Vq) (3) 

n 

= -/l(KU|Vq) - -/l(KU|Ye,Vq) (4) 

n n 
W 1 1 

< -/i(kU) - -/l(AlU|Ye,Vq,V,ec) (5) 

n n 

-/l(/tU) - -/l(AtU-/3(KU + We)|Ye,Vq,Vsec) (6) 

n n 

-hUV) - -h((l - i3)kV - /3We) (7) 
n n 

(s) 1, f {l-a)P\ 

Here (a) follows because of the Markov chain V {Vg,KU) —>■ X. {h) follows from the chain rule of mutual 
information, (c) is obtained by the choice of our coding scheme for Vq, which is designed for perfect secrecy 
from the eavesdropper. Hence i/(Vq|Ye) = //(Vq) or /(Vq; Yg) = 0. We obtain the first term in {d) since Vq 
is independent of U, and the second term follows because conditioning reduces entropy. In (e), [5 is chosen as 
P = (i-a)P-fo-2 ■ (/) follows because (1 — /?)kU — /5We is orthogonal to Yg, Vq and Vgec and finally {g) follows 
as all the terms are Gaussian. The distortion as a function of SNRa is plotted in Fig. 2 for /^ = 0.01, which shows 
that the hybrid scheme performs better than both the uncoded and the separation based scheme. Fig. 3 shows the 
performance of the hybrid scheme for different values of /^ and this shows that the distortion exponent is —1 for 
/e > . Also the distortion that can be achieved at the eavesdropper can be lower bounded by (7^2^^^=. This can 
be seen to be reasonable large when /^ is small. Hence the eavesdropper gets only a poor estimate of the source. 

A trivial outer bound for the problem can be obtained by assuming that the transmitter has knowledge of SNRa- 
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[6] considers the rate distortion problem for the Shannon cipher system. It can be seen from [6, Theorem 1 with 

Rk = 0], that the Shannon cipher system reduces to the wire-tap channel setup and the optimal distortion can be 
achieved by separate source coding followed by secrecy coding. We first quantize the source v to Vq at a rate R. 
For a maximal leakage rate of I^, the maximum value of R = C^^j — C (^^^ + le- This can be obtained by 

following the steps outlined in the Appendix. Hence we can achieve a distortion D = a^2~'^^ corresponding to the 
above R. Fig. 3 shows the outer bound and we see that the achievable scheme has a constant gap from the outer 
bound. 

IV. Conclusion 

In this work we considered joint source channel coding schemes for transmitting an analog Gaussian source over 
a Gaussian wiretap channel. We analyzed the performance of a few schemes under SNR mismatch. We showed that 
for a fixed information leakage to the eavesdropper I^, we can be optimal for a design SNR and also can obtain a 
graceful degradation of distortion with SNR. A problem of interest is, wether it is still possible to get this graceful 
degradation when we enforce perfect secrecy at the eavesdropper (/g = 0)? Another possible future work is the 
design of schemes for the source-channel bandwidth mismatch scenario. 

Appendix 

In this section we show that the information leakage rate is 1^ for Ry = C (^) — C (^^^ + -^e- Applying [4, 
Theorem 1, (2), (3) and (17)] to our problem setup we obtain the following set of equations. 

JrCu — 

n 

The left hand side term can be simplified as follows, 

g(Vq|Ye) _ iJ(Vq|Ye)-ff(Vq)+g(Vq) 
^ i^(Vq) - i/(Vq) 

(a) g(Vq)-n/, 

" ^ ^(Vq) 

= Rv — le- 

In (a) we used the definition of 1^. Thus we can bound Ry as. 

Hence the maximal rate R^ for the vector quantizer can be obtained by choosing i?^ = C(^)— C^^^+ig. 
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